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ABSTRACT 

The second in a series of four papers on computer use 
in mathematics education, this paper reviews some of the pedagogical 
rationales and research evidence related to the use of computers as a 
problem-solving tool in mathematics classes. A discussion on 
philosophies and objectives, effects of computer programming on 
mathematics achievement, motivation and attitudes, and influence on 
problem-solving ability are included. For other papers in this 
series, see SE 016 289 through SE 016 292. (Author/DT) 
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Preface 



Although the most publicized educational use of computers 
is in a tutorial CAI mode, the most Dopular use of computers in the 
mathematics classroom is probably as a problem-solving and 
investigative tool. This paper carefully considers the pedagogical 
foundations for such computer use, reviews the efforts of various 
project groups and research studies involving computer problem- 
solving usage, and summarizes what is presently known about the 
effects of such usage on achievement, attitudes, and problem-solving 
ability. 

The paper also contains a critique of research and studies 
in the computer problem-solving area, and concludes with suggestions 
for further research and studies in this area. 

Marilyn N. Suydam 
Editor 



This publication was prepared pursuant to a contract with the Office 
of Education, U.S. Department of Health, Education and Welfare. 
Contractors undertaking such projects under Government sponsorship 
are encouraged to express freely their judgment in professional and 
technical matters. Points of view or opinions do not, therefore, 
necessarily represent official Office of Education position or policy. 



THE USE OF COMPUTERS IN MATHEMATICS EDUCATION 
RESOURCE SERIES 



This is a set of papers and bibliographies addressed to both 
mathematics teachers and mathematics educators. An introductory paper 
discusses the general role of the computer in education • A second 
paper considers the use of computers in what is at present their most 
widely-used role, as a tool in mathematics problem-solving, A third 
paper reviews research related to computer uses in mathematics education. 
A three-part bibliography includes selected references on the general 
role of computers, on language and programming, and on mathematics 
instructional applications. 

Tlie titles in this resource series are: 

Tl^e Use of Computers in Mathematics Education: 

I. COMPUTER INNOVATIONS IN EDUCATION by Andrew R. Molnar 

The Use of Computers in Mathematics Education: 

II. COMPUTER- EXTENDED PROBLET-I SOLVING AND ENQUIRY by Larry L. Hatfield 

The Use of Computers in Mathematics Education: 

III. BIBLIOGRAPHY 

Part 1. General Educational Role 

Part 2. Languages and Programming 

Part 3. Mathematics Instruction Applications 

A. Teaching About Computers 

B. General Uses 

C. Tutorial and Practice Modes 

D. Problem-Solving Mode 

The Use of Computers in Mathematics Education: 

IV. RESEARCH ON COMPUTERS IN MATHEJ^ATICS EDUCATION by Thomas E. Kieren 

Tlie ERIC Information Analysis Center for Science, Mathematics and 
Environmental Education is pleased to make these papers and bibliography 
available. 



Jon !• Higgins 
Associate Director for 
Mathematics Education 



COMPUTER-EXTENDED PROBLEM SOLVING AND ENQUIRY IN MATHEMATICS 

Examining the impact of technology on American education in 
1969 is like examining the impact of the automobile on American 
life when the Model T Ford first came on the market. 

President's Commission on Instructional Technology (Hechinger, 1970) 
The purpose of this paper is to review some of the pedagogical 
rationales and recent research evidence related to the use of digital 
computers as instructional tools in mathematics classrooms. In parti- 
cular, the approaches characterized by students wrdting and processing 
computer programs as mathematical algorithms will be included. A 
critique of this research and development activity will be presented. 
Finally, suggestions for further research efforts will be proposed. 

The Approaches and Intended Outcomes 
At first glance one might contemplate a very restricted set of 
philosophies and procedures would be connoted by the label "computer- 
assisted problem solving." Quite to the contrary, one finds in this 
literature subtle but important diversities in the philosophy, purpose, 
and pedagogy of having mathematics students learn to write computer 
programs. 

Philosophies and Objectives 

Foundational to probably every position is the recognition of 
the computer as a major force shaping the accelerated changes of our 
society. This leads to the contention that educated citizens of t-he 
"computer generation" should have an awareness of the capabilities and 
limitations of this modern tool. Bright (1965, p. 73) states "that 
since all professions will be radically affected by the computer, all 



students will have to learn how it works and what it can do, • • by 
using computers as data solving tools in such subjects as mathematics, 
physics, and economics," In similar fashion Travers and Knaupp (1971, 
p, 12) argue that up through the junior high school grades "the child's 
contact with the computer be primarily an education in the general 
sense. The child would become familiar with what a computer is, what 
kinds of things it can do, and perhaps even more important, what it 
cannot do." These admonitions do not clarify how much detail about 
the machine our students should be expected to learn. 

To be sure, there must be many levels of "knowing" a computer and 
what it can or cannot do, ranging from the engineer who designs its 
circuits to the systems programmer to the applications programmer to the 
citizen who mistrusts the mysterious "black box" as an error-prone, 
encroaching "brain." Some educators do advocate the use of selected 
computer science concepts along with assembler programming languages 
(Bolt and Ward3e, 1970; Sims and Blackford, 1969; Albrecht, Lindberg, 
and Mara, 1969). Most mathematics educators, however, seem to subscribe 
to the philosophy that the activity of writing, processing, and study- 
ing the output of computer algorithms should be done to promote the 
development of mathematical concepts and principles, conputational 
skills, and problem solving abilities of the student. For example, 
Dorn (1968) states: 

It is important to keep in mind, however, that such a (compu- 
ter) laboratory is best used to te-ach mathematical concepts 
and to extend the range of the mathematical topics that can 
be taught. The laboratory is not intended to be a device to 
teach programming or computer science, although some knowledge 
of these subjects will be a by-product of the laboratory's 
use (Dorn, 1968, p. 79). 



Such a perspective vouJd i;eek to rrinimize the insiruction ol detaiicd 
programmJng languages and of the n*achineVs makeup and operaLiu. . Ihus, 
simple-to-iearn, ai^ebrdicall y natur.^i prograTiinliig languciges would be 
usea . 

I'Ui'thermort-., Dorn's viewpoint suggests that Li-e use ot conpaters 

to teach inathcmacics may icsult in soir.e adjustr.er.ts in the relative 

eip.phasis given to particular topics and objectives. Buchman (1969) 

argues that the increased use of caJculators und computers in a wide 

range of society activities is pointing to tlie need cf further ciianges 

in the objectives of teaching mathematics. As a particular chesis 

for further modification of these objectives, he states; 

Nov;, with the vide use of the electronic digital computer 
which can not onlv out-cipher the fastest human cipherei', but 
also can solve «i V/ide spectrum of problems, it nay be that the 
particular objective of developins; pupils v7ho are rapid 
calculators with large numbers must be replaced, finaiiy with 
the objective of developing pupils who can interact with these 
computers (Buclimanj 1969) . 

And in discussing questions abc at chc ultimate objectives o. mathematics 
educat:\,.n Begle (1969, p. 3) raises^ as aii example, the question 

Should all stuuents be ^.xpectcd to ^^rasp the nature ol algC'rithnic 
pruc^isses sufficiently ivoli so that they can understand what a high- 
speed electronic comptuer ran do ar:d wh.aL il cannot Jo?" 

Another aspect of ihe impact of computer use o:. » '^.c objectives 
f-f mathemari»-s education is suggLSted in Dorn's ref o enc. to a labora- 
tory approach (see also Dcrr, 19V0, Hugh-"s, 1971, Kieren i9b9a) . 
Considerable attention Ij being given to investigating the pedagogy 
and effects of "activity" learning (K ieren, 1969b) . In most of these 
contexts ijtudcnts engage in the manipulation and observation of 



carefully structured concrete materials whose properties suggest 

important attributes of specific examples. Student behaviors often 

include the interpretation of given questions or problems, aimed at 

directing search behavior, the exar.ination of specific instances with 

the concrete riaterials, the study of several instances to detect common 

properties, the formulation of a generalization about observed properties, 

and the testing of this generalization with additional examples. It 

would appear that those v;ho view the computer as a laboratory tool 

see it as a device to help bridge the gap between these behaviors with 

concrete materials and the purely sjmibolic coding structures of the 

nathematician. The computer would be used to generate or accept those 

numerical instance? of interest to the student, manipulate and print 

out the results of these manipulations, and then perhaps be used to 

process a more general program which incorporates the generalizing 

which the student has been able to accomplish. Such emphases embody 

the spirit of an education where one learns competence rather than 

particular perf ormcnces . Bruner (1970) advocates such basic changes 

ip pedagogical practice when he proposes that 

education must concentrate more on the unknown and the 
spi>culative, using the known and established as a basis for 
extrapolation. . . . The reward for working one^s way through 
the known is to find a nex^ question on the other side, 
formulated in a new way. Let it be plain that inquiry of 
this kind can be made not just through 'the social sciences* 
but equally via the arts, literature, and philosophy, as 
well as by the syntactical sciences of logic and mathematical 
analysis (Bruner, 1970, p. 78). 

Another philosophy of computer usage emphasizes the creativity 

of the student programmer. In this context the student would be taught 

how to control the machine in order to provide a context in which he 
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could invent algorithms which appeal to his personal interests. The 
Dartmouth College Project (Danver, 1969; Kurtz, 1968) is an outstanding 
example of promoting the computer as a creative extension of a student's 
intellect. 

Spine P oda.t,oftical Rati onales 

Kieren and Hatfield (1971) atteir.pted to identify in terms of 
desired student behaviors several rationales for utilizing computer 
algorithn-.s in teaching school mathematics. They noted that in construc- 
uir.g \ successful computer algorithm (program) the student must complete 
■. careful analysis of the piocesses of the problem. This often requires 
a n>ore intensive study of the defining attributes and restrictive 
conditions of the concepts involved thai, might otntn-'i'^e occur. This 
careful study by the student should serve to reinforce and clarify the 
concepts and procedures being taught in class. In each instance the 
task would be to write a computer algorithm based on the student's 
V-.r.ov; ledge of the concept and on a known non-computer procedure for 
detenrdning instances of the concept. The central focus of this first 
cor.puter use is in the designing of the algorithm; the computer output 
inight be viewed as almost perfunctory. Of course, it does provide a 
mean:i of testing the validity of che student's program and thus serves 
as a feedback-reinforcement mechanism. 

An increased emphasis on the subseouent usage of the computer 
output by the student leads to the computer used as an experimental 
tool. In this second usage the output is used to foster inductive 
strategies aimed at generalizing and discovering. In these instances 
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a student would specify in his algorithm the generation of those cases 
he anticipates will be useful in identifying a pattern or consistency 
fiom which he can then state some conjecture. The computer algorithm 
is being characterized in this sense as a computational decision tool 
for generating and manipulating data to explore cause-and-ef f ect 
questions as well as for identifying patterns. 

These viewpoincs suggest the utility of a computer program as a 
'dynamic" problem solving tool. Any computer program, good or bad, is 
an active object. With it, the student can command the computer to do 
something which he can observe, study, and modify. Feurzig and 
Papert (1968, p. 12) describe programming as a constructive problem 
solving process: "A solution to a problem is built accordiog to a 
preconceived, but modifiable, plan, out of parts which might also be 
used in building other solutions to the same or other problems. A 
partial or incorrect solution is a useful object; it can be extended 
or fixed, and then incorporated into a larger structure. These remarks 
arc true of mathematical thinking in general. But in most contexts 
they are too subtle to be meaningfully taught. An important example of 
how programming brings them down to earth is the use of the process of 
debugging programs as a paradigm for the crucial - but neglected - 
aspect of mathematical thinking that has to do with turning errors to 
positive advantage. 

It is probably this opportunity to arrive at a satisfactory indi- 
vidualized program (solution) through c "successive approximation" 
approach that results in the high level of student motivation which 
many high school cor.iputer projects have reported (Haven, 1968; Johnson, 



1966; Kurcz, 3968; Lund, 3969) ilany sLudencs will persist through 
severa] versionr> in refining and extending an already successful pro- 
gram. Perhaps these students ari.-; exhibiting a natural, early st.^te of 
what mathematicjans el'isively describe as "elegance." 

Programming er.;uh£3i^85 tht lacchuds of obtainint, solutions. At the 
same time^ students have a setting where they can extend, revise^ and 
refine their efforts to a more general algorithm aimed at processing 
entire classes of problems. The computer will serve as a precise 
judge of each individuai approach, whatever the level of sophistication. 

The student leaxns to consider extreme or special cases where the 
procedure he is designing failg. Since a program requires a Jogical 
organization, a student encounters various patterns of reasoning in the 
decision structure of the program and In the cmiputer output, incorrect 
output might be bsed to rac^.. at wliat values the procedures of the pro- 
gram began vo show eiiors. Corrriot sequencing or arrangement oi condi- 
tLonal branching involv^:; t:hft logical connectives aiid and or used to 
find soli tlon sets for conju-' .an: L.-? junctive systems oi mathemaci- 

caJ conditions , 

ihe elusive .loLion o! '^^^i-"iVDie becor.v^s ii.ore operant <',s the student 
deals with a system l.j v^nicn a :v,mb I ^variable) denotes any men^bt^r of 
a 3ct o.r replacements bvt which at r.n> gixen instanc during ^iie 
piocessitig of the program .ir actually be assuming ^' the peniiissable 

vajue^. As cht: student ooui;triicts :jV tests his aigorithn), he ca.; 
int^^rpret var.iAbLes in terms of cuirentl) assigned vvilues. Thus> 
general.-: eed pxoceuures (^an r.vcome ea^^ier to design or cc-Lr.prehend . 

Numerous excel ten t accounts oi ihc pudagogicaJ advantages of using 
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a computer as a tool to promote student concept reinforcement and pro- 
lion solving in school ir.atheriiatics are available in recent issues of 
Ikg^^igtheinatics 'Ieaj:jier. Cue classroom teacher's account is particular 
descriptive. Hu^/nes (1971) notes the need , _lly selecting 

concepts and problems to which computer use naturally makes a mathema- 
tical contribution. Using a study of Gauss's Theorem for construc- 
tible regular n-gon^j as a problem setting, she reports: 

In no case was a first program run successfully, although 
nearly all were at least partially successful. As students 
analyzed their programs to make corrections, they saw they 
had not completely understood Gauss's concept and were obliged 
to reexamine h:*s constraints to see which ones they had not 
built into their algorithms. The writing and rewriting of 
these programs furnished a clear-cut example of the power 
of computer assistance to clarify a concept by requiring a 
student to verbalize it accurately and completely. . , the 
students who attempted it found it difficult but not impossible, 
the kind of problem that seizes hold of the mind so that 
the only way to be free of the problem is to solve it. All 
students in the twelfth grade and a great many in the eleventh 
grade found solution, although these differed greatly in 
generality. Students were severe critics of each other's 
programs, and mny wrote additional programs with new data 
lists to prove that their algorithms were completely general, 
rhey were watchful for cases where the algorithm produced 
the right number of sides for the wrong reason and were 
critical of programs that required excessive computer time 
to run (Hughes, 1971, pp. 156-7). 

Considerable activity with computer programming at the college 
level can be found. The Committee on Undergradua'je Programs in Mathe- 
matics (CUPM) of the Mathematical Association of America (1964, 1969) 
has offered recommendations supporting work in computing. A recmt 
CUPM Newsletter (1969, p. 2) cited the following reasons for using 
the computer in teaching calculus: 

... Freshman calculus, because of the nature of the subject 
and its placement in the undergraduate curriculum is a good 
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course for the i-itroduction of computers into the student's 
thinking rnd working habits. 

2. Overall student interest and comprenhension is increased 
as learning is turned into a nore active, less passive ex- 
pericucej and more emphasis is given to the "constructive" 
and algorithmic aspects of the calculus. The computer 
gives the student opportunity for experimentation. 

Problems become more real, more challenging, more inter- 
esting, and less tedious when programmed for a computer. 

The Center for Research in College Instruction of Science and Mathema- 
tics (CRICISi\M) has developed a computer-oriented calculus text which, 
according to a recent CRICISAiM Newsletter (1970), is being used this 
year in approximately seventy universities and colleges. Mo indication 
of plans for controlled experimentation have been noted. Finally, 
Dorn and Hoffman of the University -;f Denver Research Institute are 
directing a Computing and Mathematics Curriculum Project which has 
prepared insLructional materials for a computer extended calculus 
treatment , ^ 

Thus, there appears to be reasonable diversity in the purposes 
I'cr teaching students how to program a computer. While there may be 
«-ontinued disagreement about how much emphasis should be placed on 
computer science topics or which programming language should be 
taughc or when students should be taught how to program, it would 
seem that engaging mathematics students in using the computer has 
fi ed the imagination and enthusiasm of many mathematics educators. 
But what research evidence can be found to support the claims offered 
bv computer enthusiasts? The experimental studies and project 
r.^ports are reviewed in the following section. 

■^For further information, write the Department of Mathematics, 
University of Denver, University Park, Colorado 80210, 
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Project Efforts and Research Results 
A variety of exploratory projects has emerged in recent years 
devoted to the study of the feasibility and advisability of using 
computers and computer prograraraing in matheniatics instruction. No 
effort will bp made, here to exhaustively review all of these projects, 
instaad those knowr developments which offer or intend to offer 
either "conclusion-oriented" or "decision-oriented" findings (Cron- 
bach and Suppes, 1969) will be included at this time. 

The n Cfects of Computer P rogr amming on Achievement in Mathematics 

Most investigators have sought to examine the following 
quesLion: Does the activity of writing computer programs and the 
study of computer output affect the achievement of mathematics students 
when the problems to be programmed are directly related to the regular 
curriculutis? 

Danver (1969) reports on the Dartmouth College secondary 
schools project. Eighteen New England secondary schools have been 
participating in a three-ye..*. NSF project to experiment in computer 
training and use. The main purpose cited is to demonstrate the use 
of the computer as a broad aid to secondary education without requiring 
major curriculum changes or extensive teacher retraining. Although 
no controlled studies of student achievement were conducted, Danver 
(1969, p. 15) states, "Many teachers claim that the students who 
become interested in computer applications to their coursework learn 
far more than the other students because of it. They use it to 
explore and to answer questions unanswered in class." Additional 
comments are reported fro..i project teachers who a" 1 support computer 
access for students. 



Project LOCAL has involved five Massachusetts School systems 

in a two-year projeiCt v;ith objectives that include experiuienting with 

studor.ts ui^ing the computer as a problem-solving vehicle. Haven (1970) 

reported in a preliminary release the results of two independent 

statistical analyses involving or.9 junior and one senior high school 

sample. Univariate and multivariate <^nalysis of variance of measures 

of matheP'atics achieveu.eat, attitudes toward computer assisted methods 

of teaching, and general changes in motivation were completed. The 

Cooperative Mathematics Achievement Tests for Algebra, Trigonometry, 

and Analytic Geometry were administered pre- and post-treatment to 

the high school sample. Reporting or- the univariate analysis. Haven 

(1970) states that 

the mathematics achievement subareas were the portion of the 
evaluation wherein the most probable effects or the treatments 
were expected. Impressive differences were indeed found, in 
treatment effect and in pre-post measurement, all significant 
at the .05 level. It appears clear that the effects of compu- 
ter-assisted instruction have a direct influence upon the 
measures of achievement in the areas of mathematics (Haven, 
1970, p. 5). 

Multivariate analyses appeared to substantiate some notion of treat- 
ment effects with only the Analytic Geometry results being signifi- 
cantly different. Haven (1970, p. 5) summarizes with the observation 
that "although the cause of such high significance in the area of 
analytical geometry (with no significance in any other math subareas) 
Is unknown, the treatment effects seem positive." Only small differen- 
ces were found in the analyses of the STEP Mathematics Test data 
from the junior high school samples. 

The computer was used as a problem-solving tool in two studies 
conducted as a part of the University of Minnesota CAMP Project 
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(Johnson, 1966). Kieren and Hatfield (1971) report on the 
results of replicat-ed experiments involving grade seven and eleven 
stu'ionts. Corparigons involved several perforniance measures obtained 
frun constructed and standardized tests. In the first experiir.ent in 
^^rcicl< seven, significant treatment effects favoring the non-computer 
groi'p were c;byc:'veG on the initial unit test (nuneration systems) 
with the frealest ciffere'^.ce occurring at the low previous-achieve- 
ment level. The ^earning of this mathematical material seems to have 
been confounded b;- the concurrent introduction of the BASIC programxung 
'procedures. A revision of the approach taken in this unit resulted 
in ac differences between the treatmen:s of the second year. In the 
:-^ra:le seven experiment of the second year, significant treatment 
efft^cts 1 avoring the computer group were observed on one post-unit 
test (elementary number theory) and on two post- treatment tests 
(Coi> temporary Mathematics Test, Junior High Level, and a problem- 
solving test). The treatment effects obtained on the test following 
li.e elementary number theory unit were viewed as especially important. 

This unit was recognized as being a particularly significant 
netting for use of the computer. The calculating power and 
speed of the nechine provided the incentive to construct 
:ilgorithms to handle nearly every concept and process studied. 
Thus, the activity of algorithm design probably functioned 
to reinforce and clarify ideas. Furthermore, this mathema- 
tical material especially lends itself to promoting the 
exper Iraental power of the tool. Therefore, students were 
challenged to research several topics with the computer. 
This approach seemed to enhance the productivity of students 
at all ability levels. This observation is supported by 
the results on the unit test (Kieren and Hatfield, 1973, 
p. 11). 

In the grade eleven experiments signif:icant differences 
favoring the computer treatment occurred on one post-unit test (quad- 
ratic functions) and on one post-treatment measure (Contemporary 



13 

Mathematics Test, Advanced Level). On the trigonometry unit test, 
however, the regular treatment group achievement significantly surpassed 
that of the computer treatment. N'o significant treatment by previous- 
achievement level interactions were observed for all measures at either 
grade level. However, the results suggest that the average and above- 
average seventh grade achievers seeined to benefit relatively more from 
the computer treatment while the grade eleven study suggested a positive 
differential effect for its average achievers. A null hypothesis of 
no difference in the proportion of students correctly responding to a 
test item was tested for each of the tests. In the second year the 
grade seven computer group scored significantly better on 25 items 
while the non-computer students were favored on 13 items. This hypo- 
thesis was rejected for 43 items in the grade eleven replication with 
the computer group favored in 16 items and the non-computer group 
in 27 items. 

Wallace (1968) studied the impact of computer mathem<itics on 
the learning of high school trigonometry. He involved classes of 
eleventh and twelfth grade students in three separate treatments: 
Class I was taught trigonometry conventionally; class II was taught 
a semester course in computer mathematics, then trigonometry as for 
Class I; and Class III was taught fifteen weeks of trigonometry, then 
was given review for three weeks during which flow chart and elementary 
cc';.nuter techniques were used as yet another means of learning trigono- 
metric relations and problem solving. The Class III students showed 
significantly more gain in knowledge of trigonometry. No explanation 
is offered for the observed result. Wallace (1968, p. 3540-A) concludes 



that "the use of f!'.ow charts and algorithmic methods in teaching 
r.athematics appears to fortify conventional teaching methods, with 
the result that higher learning rates are attained/' It should be 
notctd that this experimental result is somewhat in dissonance with 
Klereri's (1968) results in the grade eleven trigonometry unit of his 
expcrlniGnts . 

The widespread eirorts to study computer programming in school 
mathematics are not: restricted to the United States. Lund (1969) 
describes the results of a pilot study conducted in The Hague, 
Netherlands, with seventh and eighth grade mathematics students. 
After initial instruction in writing mathematics programs in the BASIC 
lanp^uage, these subjects were randomly assigned to three alternating 
experimental and control groups at each grade level. During a parti- 
cular instructional unit control classes did not utilize computer 
methods to study the same content as the computer treatment groups. 
The performances of the computer treatments were higher, but not signi- 
ficantly so, on all tests given subsequent to each unit. Additional 
research is planned when further curriculuon usages are identified and 
inscrvice training of faculty has been completed. Lund (1969, p. 4) 
concludes: "In summary, our experience with a time-sharing system 
here in Holland has convinced us that computers offer a valuable 
contribution to the learning and teaching of mathematics." It may be 
appropriate to note that further European activity is also expected 
as a result of the international Project for Computing in the 
SchDols.^ 

"For information contact Mr. Bryan Thwaites, 11 Thistle 
Street, Edinburgh SH2 IDG, England. 
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At least one study has attempted to examine a programming 
approach across mathematics classes at the seventh, eighth, twelfth, 
and college freshmcin levels, Washburn (1969) coordinated programming 
exercise_> Vvith the mathematical topics of a particular course in an 
effort t stu-'v the. effect of requiring the student to re-examine 
his Knowledge and understanding of one or more concepts required by 
his course. The students in the experimental classes were taught 
the eifiments of the CUPL programming language as they were needed for 
the programming exercises. The students in both computer and control 
groups were pre-and post-tested on all tcvics. As a result of his 
experiment, Washburn (1969, p, 5179-A) concludes: "The writing, 
execution and correction of computer programs can strengthen one's 
urderstanding of mathematical concepts. This gain is independent of 
oae's age and level of mathematics achievement. Although students of 
hij;her inte] I i^^encG tend to derive greater benefit, students of average 
uiic] lower intelligence benefit as well." It was not reported whether 
this ability difference is consistent across all grade levels. 

Several controlled investigations have been completed with 
samples of college students. While most studies at this level have 
fccassed on the introductory course in calculus, Morgan (1968) 
sought to examine the role of the digital computer in a college 
general education course in mathematics. He attempted to identify 
topics from computer science with inherent mathematics appropriate 
for general education students. The direct objectives were to provide 
and maintain basic mathematical skills, to develop a familiarity 
with and an appreciation of elementary aspects of computer science. 
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and to establish positive attitudes toward mathematics. It was not 
cjcir to this writer exactly what was the nature of the • treatment ; 
in particular, it was not indicated whether subjects were simply 
told ^oout selected computer applications or whether they were taught 
a pro;^LM:^'i;.ing language and then used it to write or interpret programs 
stei>ming from ap!»llcations . In any event, Morgan (IS 68, p. 72-A) 
reports that '^results of the standardized post-test wore L;ignif icantly 
better than the pre-test. It appears that general education students 
can enhance their iiatheraatical competence when the content is inte- 
i'j'aiod wilh computer-based application." 

Fielder (1Q69) compared course achievements for two groups 
of Analytic Geometry and Calculus I students. Four mathematical 
concepts were selected for the investigation: functions, limits and 
differentiation, iteration, and integration. One group wrote FORTRAN 
IV programs to solve homework problems while the other class completed 
homework in the usual way. Four constructed tests were administered 
as pre- and post-test for each concept phase of the experiment. 
Applying analysis of covariance at the 0.10 level of significance, no 
statistically significant difference in achievement between the treat- 
i^enl groups was foand. Of course. Fielder (1969, p. 3911-A) concludes 
that, "students learn mathematical concepts just as well by computer 
proj;ramming as they do by solving problems in the usual homework 
structure. '* 

Holoien (1970) points out that no computer terminal was used 
in the classroom in Fielder's study. Viewing such contact as impor- 
tant, he arranged to make an instructor's demonstration terminal 
available to his experimental calculus groups. These students learned 
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a i'orniat-f ree version of FORTRAN' to complete the programs required 
ror about half of the homework exercises. Students submitted hand- 
written prograns to be keypunched and processed in the campus computer 
cent^A with about a one-day lunv-around; chat is, students generally 
die :.t u^-^ the terminal in the classroom for "hands on" interactive 
executions of their programs. Holoien observes that unavailability 
oi a nearby time-sharing computer system with a conversational pro- 
gra.mring laii^^uage such as BASIC precluded implementing a more desirable 
terihina] facility. Although the effect due to instructor is confounded 
in the expori.r.ental design, he obtain- <;oi:ie interesting results. 
The hypothc'sis of no difference in scores on achievement tests for 
two trenv-ients was tested for each of three unit tasts, the final 
exaiiiination and for all four treated as a single test, A near- 
significant F-value (,05<:p<.10) was observed on the test for the first 
unit, favoring the computer treatment. He was able to reject the null 
hypothesis (p<.025) in favor of the computer group for the second 
unit test which dealt with evaluating functions and the limit of a 
function at a point. Uoloien (1970, p. 59) observes: "It is worth 
noting that some of the concepts that especially lend themselves to 
coirputer programming appear in the part of the course sampled by 
Unit Test II." A significant difference favoring the computer group 
was also observed on the pooled-data analysis. He also noted inter- 
action effects on two unit exams and on the pooled exams favoring 
the computer treatment for students of lower mathematical ability, 
iloloien (1970, p. 65-6) notes that "such results are probably what 
one would expect; that is, higher-ability students learn mathematics 



concepts regard J es.-. oC teaching methods used whereas those of lower 
ability seen, to do better when special learning aids are used." 

The two other known studies of a computer-oriented approach 
10 calculus yielded rCiSults which support the significance lioloien 
obsc'ived. Dell (1970) used the last six weeks of an introductory 
calculus course to conducL his experiment. Two sections of students 
stucied calculus using a prepared calculus manual. These materials 
wjrci identical for the two groups except that the Experimental Mate- 
rials contained six computer-oriented problem sets to be solved by 
wri-tin^ and executing computer programs. In place of these problem 
^eis the Control Materials contained six problem sets composed of 
non- calculus problems to be solved by writing and executing computer 
programs, and calculus problems to be solved without using a computer. 
Thuf^, both groups in this study were taught to use the computer. 
Hypotheses of no differences in performance involved examinations 
jI techniques of calculus and understanding of calculus concepts 
administered immediately after instruction and one month after 
instruction. Using achievement data from four examinations, these 
hypotheses were tested in three ways: (1) using t-tests for dif- 
ferences between means of scores; (2) using analysis of covariance 
for differences between means of scores by controlling for differences 
In SAT-Mathematics scores between the groups; and (3) after selecting 
matched subgroups of 36 students from each of the groups, performing 
t-tests for differences between means of scores • Hypotheses dealing 
with knowledge and retention of technivques of calculus were not 
rejected for any of the four examinations. However, significantly 
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different performances in immediate and retained understanding of 
c'llculus concepts were ob erved for all four examinations in favor 

the er.perimenta L group. Bell (1970, p. 1096-A) summarizes: *'The 
conclusions of the experiment support the hypothesis that a computer- 
oriented approach to calculus is an effective method to promote 
understanding of concepts and to increase students' interest in calcu- 
lus, and does not interfere with students' learning to apply techni- 
ques of calculus." 

The four concepts of function, limit, derivative and applica- 
tion of deri\/ative (Newton's method of approximating solutions of an 
equation) were featured in the computer homework assignments in an 
investigation completed by Bitter (1970), Two introductory calculus 
cias.ses taught by the same instructor were compared at each of three 
participating colleges. Students in the computer-extended groups 
solved calculus homework assignments by writing BASIC programs which 
tney executed via time-sharing remote terminals. Using the Coopera- 
tive Calculus Mathematics Test, Forms A and B, and a pre-test/post- 
test control group design. Bitter tested an achievement null hypothe- 
sis for Part 1 (differential) and Part II (integral) scores. Part 
1 items dealt with the computer-extended topics while Part II items 
did not include any questions related to the computer applications. 
Bitter reports that the subjects who were provided with tne computer- 
extended instruction scored significantly higher on Part I while no 
significant differences were found on the Part II data. An interes- 
ting sidelight to this study is that, disregarding the treatment 
effect, the female students achieved higher than their male 
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counterparts. Nc differences in treatment effect for the sexes was 
noted, however . 

It should certainly be apparent, with its short history and 
idditicnal resource requirements , that investigations with computer- 
expended problem solving are reasonably scarce. The studies reviewed 
here offer some initial evidence across mathematics instruction from 
junior high school througn beginning calculus. The conclusions which 
one might attempt to state from the achievement findings can at best 
be vague and tentative. Does computer-extended instruction affect 
the achievements of students with respect to the regular objectives 
and content of mathematice instruction"^ Overall, thc.-e appears to 
be some support for the claim of improved concept and principle knowl- 
edge and use. 

It would also seem that students of junior nigh school age and 
older can and will learn to write computer programs to study mathema- 
tics, although some concerns should be shown for how the programming 
IS introduced and which language is chosen. All of the studies 
reported here were administered within the framework of the experi- 
mental treatment instruction in the elements of a programming language 
and the techniques of constructing a program. Several different 
languages were used as were several different degrees of student 
access to the computer. Although not a definitive result, it would 
appear that treatments which used a conversation??l programming 
language and which provided direct student access through a computer 
terminal were more often able to show significant treatment results 
favoring the computer groups. Hunka (1970) observed that the language 
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APL was quite easy for elementary and junior high students to learn, 
but teachers at the senior ^igh level reporter' student difficulties 
in learning APL. This surprising report may be explained in part by 
exaiTiining the type of usage made of the computer at each level. 
Teachers and students at the lower levels primarily wrote functions 
for drill and practice work while the stress on algorithmic solutions 
to problems in the high school led Hunka to state the ''even though 
some (high school) teachers had taken the basic computing science 
course at the university, whi^h included APL, knowing APL operators 
and being able to construct educationally useful functions in support 
of the curricula is not always easy (1970, p. 8)/' 

MnMv ation and ^Mtitudes Toward Computer-extended Prpbj^.m_Solvins, 

One of the outcomes lauded by educators who are computer 
proponents is the increase in interest and enthusiasm of students 
toward doing mathematics in a computer algorilhin design context. 
Nearly every development project report will contain numerous des- 
criptions of btudents who become "turned ou''- by the computer. For 
example, Haven concluded an anecdotal account with the following: 

The force of the computer's motivating power is often 
so strong that it leaves aachers a little flabbergasted. 
In fact, teachers are finding that with some students 
the must guard against "over-involvement''. Michael 
Woltr, in a recent article in Science and Technology 
ma-azine, coined a term which very aptly sums up this 
siLuation. It seems that two institutions spawned by 
modern-day affluence, the ski-bum and the surfing-bum, 
are now being joined by another rapidly growing group, 
the ''computer-bums"; that is, students who would rather 
work with the computer than do almost anything else* 
However, if handled correctly this effect is all to the 
good, as it provides the school a valuable tool to pro- 
mote learning by making subject matter interesting and 
.iiaeningful (Haven, 1968, p- 44). 
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Project LOCAL subsequently attempted to evaluate subject's 
attitudes toward computer assisted methods of teaching. The analysis 
performed at the high school level included the use of the Kuder 
Preference Record, Vocational Forra C, with data gathered before and 
after the year's treatment. Significant treatment eftects due to 
students b'r.ifting their career choices demonstrably were shown in 
the univariate analysis. However these significant values did not 
hold up under the :nore sensiti>;e multivariate analysis (Haven, 1970), 

Several of the studies described in the previous section 
included efforts to assess student attitudes. Washburn (1969) used 
a testing instrument at the end of his experiment to measure student 
attitude toward the computer enriched approach. "Not only is there a 
strong positive student attitude toward the Computer Enriched Mathema- 
tics Program approach, there is an indication that this approach can 
also improve student attitudes toward mathematics in general. These 
attitudinal trends are independent of one^s age, level of mathematics 
achievement and intelligence (Washburn, .1969, p. 5179-A)/* 

Holoien (1970) used the Rabinowitz Attitude Inventory as a 
pre- and post-test in his '.alc*jlus classes. He was unable to reject 
the hypothesis of no change in attitude toward mathematics over the 
project period. Written comments were solicited from the experimen- 
tal classes at the end of the experiment. Holoien (1970) summarizes 
his descriptive treatment of these student comments: 

It is quite apparent that a large majority of student to 
whom computer-supplimented calculus was taught were favorable 
to the use of the computer. The two criticisms mentioned 
most frequently by students who were favorable toward the 
use of a computer were 1) the programming part of the course 



vas too c^"ncen:rated and 2) a co':ipater t:cr".i:i.J s ^^uld have 
been available for -itiidcnts to usu outsiao o: c . . (L^ K ien, 
1970, 71) . 

Discussing tbese observations, tha investigator conjectures that if 
students had had more opportunity to use a terhiinai tt.einseives, tiit-ir 
'^l^iiludes ^ight have chaaged enou^n to be detected by an attitud. 
scale. 

The onlv other stuay vhich reported any serious attempt to 
examine attitudes of students tc\*ard computer-oriented approaches was 
the calculus experiment conducted by Bell (1970), From the results 
of a student questionnaire used to solicit opinions concerning the 
experiment, he concludes that the computer treatment increased students* 
interest in the calculus. No further details are provided as a basis 
for this conclusion. 

The interpretation of these results must remain even more 
tenuous than those offered about achievement effects. Clearly, mathe- 
matics educators who utilize computers as problem-solving tools 
consistently applaud the motivating power of this instructional 
approach. Yet the experimental evidence awaits generation. 

Influence on Problem Solving Ability 

Because the activity of writing, processing, and correcting 
roiT'puter programs is often characterized as probieir. solving behavior, 
it would seen: that the study of problem solving outcomes would be of 
explicit interest to researchers in this area. Although particular 
tasks included in the achievement tests used in the studies reported 
here may indeed involve problem solving behaviors, almos" none of these 
investigators chose to explicitly examine a problem solving construct. 
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The Differential Aptitude Test, Abstract Re.:soning, served J£ 
one of the measuring Instruments in the Project LOCAL, evaluation 
(Haven, 1970). Used on a pre- and post-test basis for both the junior 
and senior high school samples, the difference scores were subjected 
to both univariate and multivariate analyses. Only marginal indication 
of a oi^nLTicant treatment effect was noted at both school levels 
following the univ<ariaLe analysis. Multivariate analysis, using an 
IQ measure as an independent variable, did not support this tentative 
significance. A third analysis of the DAT scores was performed to com- 
pare differences between tlie two school levels. Of course, large 
differences would be expected due to the level of education differences 
between the two schools. Haven (1970) reports significant results 
from treatment effects, pre-post, and between levels of education and 
indicates that cursory analysis points toward a more significant 
effect at the high school level for the influence of the computer- 
extended instruction upon the abstract reasoning ability. 

Hatfield (1969) developed a construct definition of problem 
solving behavior whicl ^sed by a panel of mathematics educators in 

identifying which test items were "problems". All items were subjected 
to a test of no differences in the proportions of students responding 
correctly to an item. Of the 38 items where performances differed 
significantly between the tv70 treatments of the <=econd year, 16 had 
been classified as "problem" items. On 12 of these items the computer 
treatment group was favored while the non-computer grade sevon students 
were favored on 4 "problem" items. One post-treatment test was included 
to examine student abilities to handle unfamiliar problems. The 
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Thought Problens Test presented detailed word problen.s requiring car<. ful 
analysis, reasoning, and insightful solutions. These items did not 
involve direct application of the concepts or processes of this grade 
seven curriculum nor any reference to computers or computer programnang. 
The significant difference favoring the computer group supports the 
hypothesized improvement of generalized problem solving abilities. How- 
ever, the modest results of these two studies (haven. 1970; Hatfield, 
1969) fail to provide even minimal certainty of the potential of this 
computer use on problem solving abilities. 

Critique of Previous Studies and Suggestions 
for Further Research 

This review has attempted to identify and report the findings 
of the research efforts directed toward the systematic study of corijpucer- 
extended mathematics instruction. About 15 known projects were con- 
tacted anc nine doctoral dissertations and five project reports were 
located for the infomation reported in this review. This certainly 
represents a minimal content and tempora"" base from which to extrapo- 
late research results and direction. However, t'ae inconsistency 
between the near-feverish contentions of positive learning effects of 
the ardent computer supporters and the lack of definitive, detailed 
knowledge of feared by the current literature prompts an effort at this 
po^nt to critique and suggest. 

Cr i ticism s 

Shulm.m (1970) lucidly argued that educational researchers 
muNi un<lcMi.rK<' :\ ^\^^n^ai^c reconstruction of their most basic tactics 
ot iiive.-^t i umi [i the w;oj 1 of an eiiipirioal ly-based discipline of 
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education is ever to becene a reality. Mathematics education researchers, 
including the authors of zhe research studies reported above, will find 
the perspectives offered by Shulman particularly appropriate. To use 
one of ShuliMnVs incisive figuratives (1970, p 392), the research 
reviewed in this paper .ippeafs to represent another of the "ever-so- 
precis^ ^i.urc t-ights, v^aiefully retracing well-worn patterns" which is 
so characteristic ot' educational research. That is to say, despite the 
visionarv use o: the computc^r as an instructional innovation, these 
researchers resorted primarily to classical, over-simplified, under- 
defined, under-controlled, non- theory-based approaches. 

The blunt questi^'n "Is c^irriculum A better than curriculum B?** 
sn.ould have been finally abandoned in the sixties after the flurry of 
dissatisfying cor^parisons of the "new" and the "old'' mathematics pro- 
grams. Yet the conclusions whicli these romputer-oriented investigations 
are able to provide to either the theory-builder or the classroom 
practitioner lend little clarity or new knowledge to the complex task 
of determining the "what, when, to whom, how, and how much" of classroom 
instruction and learning. This is not to say that no new information 
has resulted from these investigations. Certainly there are general 
indicators that will at least support teachers and researchers who 
would undertake their own experimentation in the use of computers and 
computer programming in the mathematics classroom. These studies have 
at least fulfilled a feasibility claim; that is, a relatively small 
(and perhaps select) group of teachers were able to involve students in 
■^earning mathematical content while engaging in writing, processing, and 
using computer algorithms and the computer output. However, the 
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predictability and gencralizability of the instructional methods and 
learning results of these studies are simply unknown. Tukey (1969, p. 
85) observed that the use of statistical testing was never meant to 
serve as a substitute for replication; "Repetition is the basis for 
judging variability and significance and confidence. Repetition of 
resull<:^. each significant, is the basis, according to R. A, Fisher, 
of scientific truth/' Of course, the results of the four earlier- 
sited calculus investigations (Bell, 1970; Bitter, 1970; Fielder, 1969; 
Holoien, 1970) taken collectively do represent a global sort of repli- 
cation. But certainly the variety of methods, materials, learning 
tasks, durations, testing instruir.ents, experimental desings, statistical 
techniques, and findings precludes any generalized adoption of computer- 
extended calculus as a direct experimental result. 

These studies might be characterized as **f ormulative" evaluations 
of prototypes of coir.puter-extended mathematical instruction. Certainly 
it can be argued that such efforts are appropriate to dissertation- 
level research. At the same time, the theoretical and methodological 
shortcomings of the investigations are the focus of this criticism. 
Treatments are often only vaguely defined. Although the learning of a 
programming language was central, no investigator gave any measured 
evidence of the extent of student mastery of this knowledge and skill. 
And even though the writing of programs for mathematical concepts and 
problems was the major instructional variation, no evidence is given 
for how many correct programs overall were written, how many trials to 
a correct program for each problem assigned, or the qualitative nature 
of the errors or successful programs for particular types of achievers. 
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Sample sizes are often very small ai.d information regarding 
random assignments to treatments is often lacking. The instructional 
time was sometimes not the same for computer and non-computer treatments. 
On the other hand, Bloom (1968) presented strong arguments for educators 
to control achievement level while varying instructional time and 
resources in order to permit and to promote "mastery learning". Of 
course, none of these "formative*' studies discussed here employed the 
strategies of this model (see Shepler, 1970). In one study the control 
group actually was asked to solve non-calculus problems with computer 
programs while also solving calculus problems without the computer. 
The nature of these non- calculus problems is unknown* One can only 
speculate on the interference effects provided by these additional, 
apparently non-essential tasks. Only one study explicitly sought to 
measure retention of knowledge although others used what appeared to 
be comprehensive final examinations as post-treatment measures* The 
duration of the experiments did seem adequate to have induced measurable 
change in the learners. Statistical techniques generally were viewed 
as appropriate contingent upon the satisfaction of the underlying 
assumptions. In particular the use of analysis of covariance is 
questionable unless an investigator can satisfy the assumptions of ran- 
dom assignment of subjects to treatments, independence of covariate 
and treatments, and no treatment-slope interaction. These contingencies 
were not always made clear. 

Reasonable uncertainties exist about the validity of some of 
the measuring instruments. Even in those . . ^ances where the investi- 
gators might have designed tests to reflect the intended objectives of 
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instruction, perfornanc. sr,t.=..e„ts describing terminal student behaviors 
are absent, often standardised tests of questionable appropriateness 
were employed without theoretical justification for such selections. 
And. as has already been noted, al.,ost none of these Investigators have 
replicated results to report. 

In sununary these investigations generally lack the theoretical 
rationale, the careful specification of treatments, the detailed monito- 
ring of treatment effects on those aspects crucial to the experiment, 
and the objectives-valid measurement of tenuinal and retained perfor- 
mances which Should Characterize "fonnative" research. At the same 
time, these few initial .f:dies provide tentative information to teachers 
and to researchers as they consider co.puter-extended mathematical 



instruction. 



Suggestions f o^LjurjW^P^icnrch 

The criticisms submitted above invite the consideration of 
suggested alternatives for making progress in developing a predictive 
knowledge base for using classroom computers. Ideally, teachers need 
to know, to some specified degree of confidence, when to teach and use 
progranMlng. for which types of students, for which content selections, 
and how this should be done (which programming language, what kind of 
computer access, which combinations of classroom pedagogies, etc.). 
And throughout all such specifications, the intended learning outcomes 
Should be clearly explicated with performance terms and in a taxonomlc 
spec^.acation (see Wilson. 1971). Furthermore, studies of n^thematical 
learning In any context should employ existing theories of learning 
and child development in their planning, and then eventually feed back 



30 



empirical results which support or lead to modifications of these 
theories . 

The task of supplying such information to teachers and 

theories appears justifiably complex. Shulman (1970) characterizes 

most schooling situations as highly complex and variegated activity, 

involving students, subject-matter and sources of instruction. 

Any research which purports to deal systematically with 
phenomena at this level of complexity must itself reflect 
an appropriate level of complexity. The ideal research 
setting. . . must be (1) experimental ; (2) longitudinal ; 
(3) multivariate at the level of both independent and 
dependent variables, and consistent with that; (4) difer - 
ential , in that the interactions of the experimental 
programs with the students' entering individual differences 
are treated not as error variance, but as data of major 
interest in the research (Shulman, 1970, p, 387). 

What, then, is required are considerable more detailed efforts 
if we are to move beyond studies where the primary conclusion is that 
"more research needs to be done". Of course, a more extensive pro- 
gram of research x^ill also require small, one-shot, "clinical-level" 
studies whose function will he to generate hypotheses. Such work may, 
in fact, become the coordinated contributions That doctoral disserta- 
tions may make. But we must realize that the programmatic research 
suggested here will require that we no longer accept the individual 
doctoral thesis as the prototype for scholarly efforts in the field • 
We will need to develop a functioning cooperative effort, perhaps even 
at the inter-university level, with dissertations planned as part of 
a broader, coordinated general program of research engaged in collec- 
tively by their thesis supervisors. Models have been proposed for 
such coordinated team efforts for programs of research (see Romberg 
and Devault, 1967; Aiken, 1970). 
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To this datG, a handful of mathematics educators have shown 
reseaixh interests in the learning of mathematics with the computer 
serving as a problem solving tool. This paper's purpose was to 
summarize and discuss their work. Reflecting upon our clumsy gropings 
and modest successes, can we now consider new cooperative paradigms? 
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